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PLATFORM  MOTION  CONTRIBUTIONS  TO  SIMULATOR  TRAINING  EFFECTIVENESS: 
STUDY  III  -  INTERACTION  OF  MOTION  WITH  FIEI.D-OF  VIEW 


I.  INTRODUCTION 

Currently,  two  major  hardware  issues  are  of  concern  in  the  design  of  flight  simulators  and  the 
resulting  training  effectiveness.  The  first  involves  the  degree  to  which  simulator  platform  motion  cueing 
affects  pilot  performance,  particularly  skill  acquisition  and  its  subsequent  transfer  to  the  aircraft,  the 
dominant  question  concerns  the  extent  to  which  motion  cueing  is  required  in  the  simulator  to  obtain 
effective  training.  The  second  issue  involves  the  degree  to  which  complex  extra-cockpit  visual  displays 
benefit  training  and  the  minimum  requirements  for  such  displays  to  be  effective. 

The  value  of  platform  motion  cueing  to  enhance  simulator  training  effectiveness  has  been  recently 
questioned.  Despite  research  data  showing  improved  single-axis  tracking  performance  and  improved 
in-simulator  performance  under  certain  conditions,  there  is  no  ev.dence  to  indicate  improved  transfer  of 
learning  to  subsequent  performance  in  the  aircraft  (Puig,  Harris,  &  Ricard,  1978).  A  series  of  studies  was 
initiated  at  the  Air  Force  Human  Resources  Laboratory  to  determine  the  effectiveness  of  platform  motion 
cueing  for  naive  Undergraduate  Pilot  Training  (UPT) students  transitioning  into  the  T-37  aircraft. 

Following  final  acceptance  of  the  Advanced  Simulator  for  Pilot  Training  (ASPT)  in  1975.  a  study  was 
conducted  to  evaluate  the  contributions  of  platform  motion  to  the  acquisition  of  basic  contact  skills.  Two 
groups  (n=4)  were  trained  to  proficiency  in  the  simulator  and  subsequently  evaluated  in  the  T-37  aircraft. 
No  differences  in  either  simulator  or  aircraft  performance  were  obtained.  Woodruff,  Smith.  Fuller,  and 
Weyer  (1976)  conducted  an  exploratory  study  to  investigate  the  utility  of  the  ASPT  as  a  lull  mission 
simulator  in  the  basic  phase  of  UPT.  Block  training  was  provided  for  Basic  Contact.  Advanced  Contact 
(Aerobatics).  Instruments,  Navigation,  and  Formation  Flight.  Upon  completion  of  each  block  of  training  in 
the  ASPT,  the  student  was  assigned  to  an  aircraft  for  corresponding  instruction.  Eight  students  received 
ASPT  pretraining  while  a  control  group  of  eight  students  did  not.  Half  of  the  experimental  group  was 
trained  with  platform  motion  (n=4)  while  the  other  half  was  not  (n=4).  Proficiency  advancement  was  used 
for  all  instruction  in  both  the  simulator  and  aircraft.  The  resulting  aircraft  hours  savings  were  45%  for  Basic 
Contact,  4%  for  Advanced  Contact,  38%  for  Instruments,  and  13%  for  Navigation.  No  significant 
differences  were  obtained  between  the  Motion  and  No  Motion  groups. 

In  a  subsequent  effort,  Martin  and  Waag  (1978a)  addressed  the  same  question  using  more  rigorous 
control  procedures  and  a  larger  sample  size  Twenty-four  prefiighi  UPT  students  with  no  previous  jet 
piloting  experience  were  randomly  assigned  to  one  of  three  treatment  groups  (n=8):  (a)  Motion,  (b)  No 
Motion,  and  (c)  Control.  Those  students  assigned  to  the  control  group  received  the  standard  syllabus  of 
preflight  and  flight  line  instruction.  The  students  in  the  two  experimental  conditions  icceived  identical 
pretraining  in  the  Advanced  Simulator  for  Pilot  Training  (ASPT)  with  the  exception  of  the  presence  or 
absence  of  platform  motion  cueing.  The  G-seat  was  not  used.  The  simulator  training  syllabus  consisted  of 
10  ASPT  sorties  covering  instruction  on  a  large  number  of  basic  contact  maneuvers,  including  basic  airwork 
(turns,  climbs,  etc.),  slow  flight,  stalls,  takeoffs,  straight-in  approach  and  landing,  overhead  pattern,  and 
touch-and-go.  Following  simulator  pretraining,  the  students  were  evaluated  on  two  special  aircraft  sorties 
by  research  Instructor  Pilots  (IPs)  as  well  as  on  all  sorties  prior  to  solo  by  their  normal  flight  line  IPs.  The 
control  group  did  not  receive  the  two  special  data  rides  due  to  safety  considerations.  Evaluations  in  the 
T-37  aircraft  revealed  substantial  transfei  of  training.  However,  with  respect  to  the  two  experimental 
groups,  i  e  ,  Motion  and  No  Motion,  no  statistically  reliable  differences  were  found  for  either  performance 
in  the  simulator  or  subsequent  performance  in  the  aircraft.  Within  the  aircraft,  this  finding  was  observed  for 
student  performance  on  two  special  data  sorties  at  the  beginning  of  training,  as  well  as  their  performance 
prior  to  solo. 

With  the  exception  of  stalls,  motion  cues  for  the  training  tasks  were  incidental  or  secondary  '  the 
most  part.  Typically,  the  magnitude  of  transfer  effects  expected  from  such  incidental  mall 

compared  to  that  from  primary  cues.  Moreover,  there  is  not  a  great  deal  of  motion  cueing  involve.  ..,  these 
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talks  in  that  the  amount  and/or  magnitude  of  force  cueing  in  the  aircraft  is  relatively  small.  Fot  this  reason, 
It  seemed  necessary  to  extend  the  effort  to  aerobatic  tasks  In  which  motion  cues  are  more  prominent 
(Martin  &  Waag,  1978b).  Thirty-six  UPT  students  were  assigned  to  one  of  three  treatment  groups  (n=*l  2): 
(a)  Motion;  (b)  No  Motion;  an1'  (c)  Control.  Students  in  the  two  experimental  groups  received  five  ASPT 
sorties  covering  instruction  on  eight  aerobatic  tasks.  The  control  group  did  not  receive  any  ASPT 
pretraining.  All  students  were  subsequently  evaluated  in  the  T-37  aircraft  by  their  normal  (light  line  IPs. 
The  obtained  data  suggested  only  a  modest  degree  of  transfer.  Of  the  eight  maneuvers  trained  in  the  ASPT, 
only  the  Barrel  RoD  produced  an  overall  significant  transfer  effect  across  the  three  groups.  However, 
approximately  one-third  of  the  ASPT-trained  vs.  Control  group  a  priori  t-tests  produced  significant  effects. 
In  all  cases,  superior  performance  was  demonstrated  by  the  ASPT  trained  groups.  A  comparison  between 
the  Motion  and  No  Motion  groups  revealed  some  small,  although  inconsistent,  performance  differences 
during  simulator  training.  Of  chose  individual  aircraft  measures  demonstrating  significantly  better 
performance  by  the  simulator-trained  groups  (13  of  40),  none  revealed  a  reliable  effect  due  to  motion. 

Since  each  of  these  previous  studies  utilized  the  entire  ASPT  field  of  view  (FOV)  (which  is  300 
degrees  horizontal  by  150  degrees  vertical),  it  was  speculated  that  peripheral  cues  may  have  been  imparting 
important  “motion"  information.  In  the  event  such  visually  perceived  motion  cues  were  of  sufficient 
magnitude,  the  effect  of  platform  motion  cueing  possibly  could  be  reduced.  !t  s>:h  were  the  case,  platform 
motion  cueing  would  be  expected  to  have  a  greater  effect  for  narrow  FOV  visual  systems,  such  as  those 
used  by  some  Air  Force  operational  flight  simulators.  The  present  study  was  designed  to  address  this 
question.  Specifically,  the  objectives  were  to  determine  the  effects  of  motion  cueing,  FOV,  and  their 
interaction  upon  (a)  skill  acquisition  in  the  simulator  and  (b)  subsequent  transfer  of  teaming  to  the  aircraft. 


II.  METHOD 


General  Approach 

A  transfer-of-training  study  design  was  employed  in  which  the  students  were  initially  trained  for  a 
fixed  number  of  trials  in  the  ASPT  and  subsequently  evaluated  during  their  first  T-37  sortie.  Two  variables 
were  of  interest -platform  motion  cueing  and  the  visual  FOV.  Half  of  the  subjects  (lew  all  of  their  ASPT 
sorties  with  the  full  six-degrees-of-freedom  platform  motion.  Each  of  the  remaining  subjects  flew  all  of  their 
ASPT  sorties  without  platform  motion.  Half  of  the  subjects  in  each  of  the  motion  conditions  flew  all  of 
their  ASPT  sorties  with  the  full  FOV  (300°H  x  i  50°V).  For  the  remainder  of  the  subjects,  part  of  the  visual 
scene  was  computer  “masked”  to  produce  a  48°H  x  36°V  FOV,  This  FOV  was  selected  because  of  its  use  in 
many  Air  Force  operational  flight  trainers,  including  Air  Training  Command’s  new  Instrument  Flight 
Simulator  for  the  T-37  and  T-38.  This  resulted  in  the  following  four  experimental  groups:  (a)  full  platform 
motion,  full  FOV;  (b)  full  platform  motion,  limited  FOV;  (c)  no  platform  motion,  full  FOV;  and  (d)  no 
platform  motion,  limited  FOV. 

Subjects 

The  subjects  were  selected  randomly  from  UPT  classes  78-04  and  78-05  at  WiUiams  AFB.Thcy  were 
selected  with  the  restriction  of  having  had  little  prior  flying  experience;  the  range  of  previous  flight 
experience  was  25  to  64  hours.  Sixteen  subjects  were  selected  from  each  class.  Each  student  flew  all  of  the 
required  ASPT  sorties  within  one  of  the  four  experimental  groups. 

Instructor  Pilots 

Four  IPs  from  the  Research  Div,sion  of  the  82nd  Flying  Training  Wing  (82FTW/DOR) provided  the 
ASPT  instruction  and  T-37  evaluation.  The  assignment  of  students  to  IPs  was  counterbalanced  by  having 
each  IP  instruct  one  student  from  each  UPT  class  in  each  of  the  four  experimental  groups.  Each  IP  received 
orientation  training  over  a  period  of  several  days  immediately  before  both  UPT  classes. 
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Equipment 

Experimental  training  was  accomplished  in  the  ASPT.  An  overview  of  the  ASPT  aspects  most  relevant 
to  the  present  study  is  presented  in  this  section.  Detailed  descriptions  of  this  device  may  be  found  in  Cum. 
Albery.  and  Basinger  (197$).  The  ASPT  is  equipped  with  two  T-37  cockpits.  Each  cockpit  has  a  full  FOV 
visual  display  of  computer-generated  images,  a  six-degrees-of-freedom.  synergistic  platform  motion  system, 
and  a  16-panel  pneumatic  G-seat  on  the  left  seat  (student  position). 

The  visual  display  is  projected  through  seven  36-inch  cathode  ray  tubes  (CRTs).  The  capacity  for 
displaying  visual  image  detail  is  fixed  and  shared  between  the  two  cockpits.  A  highly  detailed  scene,  such  as 
an  airport,  requires  909c  to  1 009F  of  the  display  capacity.  In  the  present  study,  100%  of  the  visual  display 
capacity  was  used  for  training. 

The  visual  system  uses  an  infinity  optics  display  with  the  exit  pupil  located  at  the  student's  eye 
position,  but  a  distorted  scene  from  the  IP  position.  From  a  normal  position,  the  IP  is  unable  to  see  the 
visual  display  immediately  in  front  of  the  aircraft.  The  scene  becomes  less  distorted  as  the  IP  scans  laterally. 
If  the  position  of  the  IP’s  head  is  moved  nearer  to  that  of  the  student,  the  forward-looking  view  of  the  IP  is 
increased  and  the  distortion  is  reduced. 

The  platform  motion  system  is  driven  by  six  hydraulic  actuators,  each  with  a  travel  capability  of  60 
inches.  The  platform  motion  system  software  was  designed  to  provide  translational  and  rotational 
acceleration  onset  cues  to  the  student  pilot  position.  Excursion  limits  and  maximum  accelerations  are 
presented  in  Table  1.  The  drive  philosophy  for  the  display  of  translational  acceleration  cues  is  intended  to 
match  the  aircraft  acceleration  in  magnitude  and  shape,  whereas  the  display  of  onset  rotational 
accelerations  is  driven  by  a  cue-shaping  philosophy.  Some  sustained  acceleration  cues  can  be  simulated  via 
platform  movement  with  a  subsystem  called  “gravity  align"  which  positions  the  platform  in  an  attempt  to 
substitute  for  a  portion  of  the  external  force  vector.  (The  G  seat  can  also  display  sustained  ac«.eleiaiing 
cues:  however,  the  G-seat  was  not  used  in  this  Study  and  will  not  be  discussed).  The  motion  system  also 
includes  a  special  effects  package  for  displaying  such  cues  as  touchdown  bump,  runway  rumble,  aircraft 
buffet,  speedbrake  extension,  and  gear-down  rumble. 


Tabic  I.  ASPT  Platform  Motion 
Performance  Characteristics 


Axil 

Excursion 

Acceleration 

Forward  (X) 

♦49  in.,  -48  in. 

1 0.6g 

Lateral  (V) 

i48  m. 

i0.6g 

Vertical  (Z) 

+39  in..  -30  in. 

±0  8g 

Roll  (X) 

±22° 

±50°/sec5 

Pitch  (Y) 

♦30s.  -205 

i50O/sccJ 

Yaw  (Z) 

±32° 

t50°/secs 

The  ASPT  has  the  capability  of  real-time,  automated  measurement  of  the  pilot's  performance  via  the 
Automated  Pilot  Measurement  System  (APMS).  Measurements  can  be  made  of  pilot  inputs,  system  outputs, 
and  derived  scores.  A  limited  amount  of  this  information  can  be  displayed  real-lime  in  the  cockpit  via  a 
monitor  located  to  the  right  of  the  IP  position  and/or  following  the  mission  in  hard  copy  form.  The  ASPT 
is  also  equipped  with  the  capability  of  displaying  a  prerecorded  demonstration  of  a  maneuver  w  rich  enables 
a  reproduction  of  the  entire  maneuver,  including  visual  display,  motion  cues,  instrument  readings,  and 
rudder  and  throttle  movements. 

Two  additional  capabilities  of  the  ASPT  were  utilized  in  the  present  study:  problem  freeze  and 
reinitialization.  The  instructor  can  stop  and  hold  the  system  at  its  current  position  by  the  use  of  the 
problem  freeze  feature.  From  this  position,  the  IP  can  continue  flight  from  the  “frozen"  position  or  return 
to  a  desired  starting  point  by  use  of  the  reinitialization  feature.  Reinitialization  allows  the  system  to  go  to  a 
designed  position  and  configuration  in  a  matter  of  seconds.  These  points  are  preprogrammed  to  correspond 
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to  optimal  starting  positions  for  most  maneuvers,  including  cross-country  positions,  in  the  T-37  training 
program.  The  main  utility  of  the  freeze  feature  is  in  its  instructional  value,  whereas  the  reinitialization  is  a 
time-saving  feature  which  also  allows  for  tighter  experimental  control  over  student  practice. 

The  advanced  instructor  operator  console  (AIOS)  is  equipped  with  a  Vector  General  monitor  which 
has  a  spatial  display  option.  This  option  can  follow  the  flightpath  of  the  simulated  aircraft  which  can  be 
rotated  around  the  X,  Y,  or  Z  axis.  This  image  can  be  temporarily  stored  and  displayed  following  the 
mission  for  use  in  the  debriefing. 

Procedure 

Cognitive  Pretraining.  All  students  viewed  two  sets  of  cognitive  pretraining  materials.  One  set  was  a 
selection  from  the  learning  center  at  Williams  AFB.  The  students  were  required  to  view  the  material  within 
I  week  of  their  scheduled,  first  ASPT  sortie.  At  that  time,  they  also  viewed  an  audio-visual  (AV)  taped, 
safety  briefing  on  the  ASPT.  Immediately  prior  to  their  first  ASPT  sortie,  the  students  also  viewed  an 
AV-taped  ground  briefing  which  described  the  maneuvers.  The  verbatim  text  is  presented  in  Appendix  A. 

IP  Orientation  Training.  The  IPs,  who  provided  instruction,  were  also  required  to  use  specially 
prepared  data  cards  to  evaluate  the  students'  overall  performance  with  the  following  8-point  scale:  1  = 
unsatisfactory;  2,  3,  4  =  fair;  5,  6,  7  =  good;  and  8  =  excellent.  The  development  and  validation  of  these 
cards  are  presented  in  Appendix  B.  In  order  to  familiarize  the  IPs  in  the  use  of  the  scale,  practice  was  given 
by  evaluating  recorded  demonstrations.  Two  demonstrations  were  recorded  for  each  of  the  four  maneuvers; 
one  in  the  "good''  range  and  one  in  the  “fair"  range.  Before  the  first  class  of  UPT  students,  each  IP 
evaluated  the  eight  demonstrations  on  2  successive  days.  These  evaluations  were  accomplished  from  the 
right  seat,  where  the  IP  usually  sits,  and  a  volunteer  sat  in  the  student’s  seat.  On  each  day,  the  IPs  were 
shown  how  each  of  them  had  evaluated  the  respective  demonstrations  During  in-depth  debriefings,  the  IPs 
discussed  how  they  performed  their  evaluations. 

ASPT  Training.  The  ASPT  syllabus  of  instruction  is  presented  in  Table  2.  As  indicated,  the  students 
first  received  a  demonstration  for  each  maneuver.  The  demonstrations  had  previously  been  recorded  for 

Table  2.  ASPT  Sorties 


Sort)*  t 

Sortl«  2 

Sortie  3  4  4 

Demonstration 

Takeoff 

Practice 

Practice 

Practice 

Practice 

Practice 

Evaluation3 

Evaluation3 

Evaluation3 

Demonstration 

Steep  Turn 

Practice 

Practice 

Practice 

Practice 

Practice 

Evaluation* 

Evaluation3 

Evaluation3 

Demonstration 

Slow  Flight 

Practice 

Praciicc 

Practice 

Practice 

Praciicc 

Evaluation3 

Evaluation3 

Evaluat  ion3 

Straight-In  and  Landing 

Demonstration 

Demonstration 

Praciice 

Practice 

Praciicc 

Praciicc 

Practice 

Praciicc 

Practice 

Practice 

Practice 

Praciice 

Evaluation3 

Evaluation3 

Evaluation3 

3Sludcn(  performance  wav  evaluated  b>  both  the  \PMS 
and  the  vpcdal  data  card'. 
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playback  during  the  study.  Each  demonstration  contained  an  error  which  students  frequently  made.  As  part 
of  the  narrative,  the  subjects  were  instructed  how  to  recover  if  they  committed  the  error. 

Following  one  or  more  practice  trials,  the  students  were  measured  on  the  last  trial  on  each  maneuver 
for  each  of  the  four  ASPT  sorties  Student  performance  was  evaluated  by  t lie  IP;  it  was  also 
computer-scored  using  the  APMS.  Each  student  had  the  same  IP  for  all  four  ASPT  sorties. 

In  an  attempt  to  reduce  the  inter-trial  interval  and  to  maximize  the  transfer  of  training,  there  were 
several  constraints  placed  on  the  distribution  of  sorties  in  the  ASPT  and  in  the  T-37.  First,  the  T-37  sortie 
was  to  occur  not  more  than  one  day  after  the  fourth  (final)  ASPT  sortie.  Second,  the  third  and  fourth 
ASPT  sorties  were  to  occur  on  successive  days.  Third,  at  no  time  would  there  be  more  than  3  days 
separating  any  of  the  first  three  ASPT  sorties.  The  schedule  was  maintained  for  28  of  the  subjects.  With  the 
remaining  four  subjects,  an  ASPT  equipment  failure  delayed  the  fourth  ASPT  sortie.  This  resulted  in  having 
that  final  ASPT  sortie  flown  in  the  morning;  the  T-37  sortie  was  down  later  that  same  day.  There  were  no 
discernible  differences  between  the  data  of  those  four  subjects  and  the  other  28  subjects. 

In  order  to  preclude  the  subjects  in  the  Motion  and  No  Motion  groups  from  perceiving  accentuated 
differences  between  treatments,  all  students  heard  the  following  communications  at  the  start  and  end  of 
each  ASPT  sortie  “motion  coming  up"  and  “motion  coming  down."  The  platform  was  raised  and  lowered, 
respectively,  to  give  each  student  some  motion  sensation. 

T-37  Evaluation.  For  the  transfer  to  the  T-37  portion  of  the  study,  the  same  IP  who  wotked  with  the 
student  on  the  ASPT  flew  a  single  sortie  with  that  student.  This  was  the  first  time  that  any  of  the  students 
had  flown  in  the  T-37  aircraft.  The  students  attempted  to  perform  each  maneuver  in  the  T-37  without  a 
demonstration  by  the  IP.  Student  performance  was  evaluted  on  the  same  type  of  special  data  cards  used  for 
the  ASPT  evaluation. 


III.  RESULTS 


ASPT  Training 

All  students  completed  the  four  ASPT  instructional  sorties.  Student  performance  was  evaluated  once 
for  each  task  on  every  sortie.  The  occurrence  of  these  evaluations  within  the  training  sequence  is  presented 
in  Table  2.  For  each  evaluation,  two  types  of  data  were  analyzed;  (a)  the  overall  IP  rating  using  the  special 
data  cards  and  (b)  objective  scores  from  the  APMS  on  the  ASPT.  Included  in  the  APMS  data  were  root 
mean  square  (RMS)  deviation  scores  for  system  state  outputs  and  RMS  movement  scores  for  control  inputs 
on  each  maneuver.  Specific  parameters  included  in  the  data  analysis  are  presented  in  Appendix  C.  For  each 
parameter,  analyses  of  variance  ( ANOVAs)  were  computed  using  natural  log  (in)  transformations  of  the  raw 
data 

IP  Ratings.  The  overall  IP  ratings  for  the  ASPT  sorties  were  analyzed  using  a  split-plot  factorial 
ANOVA  design  having  two  between-subjects  factors  (Motion  and  FOV)  and  one  repeated  measure  (Trials). 
The  results  of  the  ANOVAs  are  presented  in  Table  3,  and  descriptive  statistics  are  presented  in  Tabic  4.  As 
indicated,  the  Trials  main  effect  was  statistically  significant  for  al  maneuvers.  A  significant  Motion  main 
effect  during  ASPT  training  was  obtained  for  every  maneuver  except  the  Steep  Turn.  There  were  no 
significant  FOV  effects  for  any  maneuver.  Furthermore,  none  of  the  interaction  effects  reached  statistical 
significance.  As  seen  in  Table  4,  the  IP  ratings  increased,  i.e.,  student  performance  improved,  with 
successive  trials  in  the  ASPT.  For  those  maneuvers  yielding  a  significant  Motion  effect,  better  performance 
was  demonstrated  by  the  Motion-trained  group  for  all  trials. 


Table  3.  F -values  for  IP  Overall  Ratings  in  ASPT 


tatvfimvnui 

CtuMMlI 

Mot  ton 

<M> 

POV 

Trlrt 

(T) 

Ml  POV 

MaT 

POV  «T 

M I POV  a  T 

Takeoff 

5.99* 

0.14 

41.03** 

0.21 

0.48 

1.85 

0.60 

Steep  Turn 

1.34 

0.52 

13.24** 

0.52 

1.18 

0.08 

1.09 

Slow  Flight 

7.66** 

2.80 

20.23** 

0.00 

0.86 

1.97 

0.S5 

Straight -In 

5.87* 

0.00 

35.25** 

1.42 

0.29 

0.94 

0.72 

•p<  .05. 

••p<  .01. 


Table  4.  Mean  IP  Overall  Ratings 


( Maneuver 

1 

_ Airr.TrUU - 

2  2 

4 

T-37  (valuation 

1 

Motion 

2.06 

Takeoff 

4.94  5.50 

6.00 

3  88 

No-Motion 

1 .31 

3.50 

4.94 

5.06 

2.56 

Full  FOV 

1.69 

4.69 

4.81 

5.75 

3  00 

Limited  FOV 

1.69 

3.75 

5.62 

5.31 

3.44 

Total 

1.69 

4.21 

5  22 

5.53 

3.22 

Motion 

2.69 

Steep  Turn 

5.19  5.38 

5.25 

3  06 

No-Motion 

2.56 

3.69 

4.8! 

5.44 

1.94 

Full  FOV 

2.56 

4.25 

5.00 

5.06 

2.50 

Limited  FOV 

2.69 

4.62 

5  19 

5.62 

2.53 

Total 

2.62 

4.44 

5.09 

5.34 

2.52 

Motion 

3.25 

Slow  Flight 

5.88  6.50 

6.50 

3.31 

No  Mot  ion 

2.63 

3.94 

5.00 

5.50 

2.25 

Full  FOV 

3.12 

5.94 

5.94 

6.12 

2.94 

Limited  FOV 

2.75 

3.88 

5.56 

5.88 

2.67 

Total 

2.94 

4.91 

5.75 

6  00 

2.81 

Motion 

1.88 

Straight-In 

3.00  5.62 

5.88 

2.44 

No-Motion 

1.38 

1 .94 

4.50 

4.62 

1.94 

Full  FOV 

1.56 

2.88 

5.06 

4.94 

2.00 

Limited  FOV 

1.69 

2.06 

5.06 

5.56 

2.43 

Total 

1.62 

2.47 

5.06 

5.25 

2.20 

APMS  Deviation  Scores.  Of  (he  two  sets  of  APMS  scores,  deviations  from  desired  state  values  are 
considered  to  be  of  greater  importance  since  they  provide  some  indication  of  proficiency.  Results  of  the 
ANOVAs  on  In  RMS  deviation  scores  for  each  of  the  maneuvers  are  presented  in  Table  5.  with  descriptive 
statistics  in  Table  6. 

For  the  Takeoff,  only  Heading  Deviation  produced  a  significant  Trials  effect.  Descriptive  statistics 
presented  in  Table  6  show  decreases  in  Heading  Deviation  scores  with  successive  trials.  Two  additional 
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Table  5.  F-values  for  4PM  In  RMS  Deviation  Scores 


MOOIUIS 

Motion 

(M) 

FOV 

Trim 

(T)  M  n  FOV  M  I  T 

fov  v  t 

M  m  FOV  a  T 

Heading 

3.62* 

0.04 

Takeoff 

27.89***  1.42 

038 

1.30 

0.09 

Attitude 

1.06 

1.07 

1  7S  0.06 

0.60 

1.86 

3.36** 

Climbpath 

0.33 

0.11 

0.52  0.05 

0.16 

1.27 

0.61 

Airspeed 

0.03 

0.33 

Steep  Tum 

5.50***  0.34 

1.97 

0.20 

1.43 

Altitude 

3.07* 

1.61 

4.69***  1.03 

1.13 

0.76 

0.56 

Bank 

0.92 

0.83 

3.50**  0.10 

0.51 

0.82 

0.67 

Altitude 

1.36 

0.50 

Slow  Flight 

8.29***  0.48 

0.S4 

III 

0.88 

Airspeed 

0.93 

111 

3.50**  2.36 

0.82 

1.05 

1.60 

Heading 

1.22 

0.74 

8.56***  0.60 

0.32 

1.24 

0.56 

Altitude 

5.01** 

Straight-In  (Before  Glidepath) 
1.56  7.20***  0.02 

1.00 

0.13 

0.73 

Centerline 

1  60 

0.24 

1.16  0.00 

1  35 

1.27 

1.27 

Glidepath 

7.78*** 

Straight-in  (On  Glidepath) 
0.15  6.87***  1.34 

0.97 

0.81 

1.32 

Centerline 

3.90* 

1.17 

3.27**  1.98 

1.07 

0.58 

0.57 

Airspeed 

1.53 

1.13 

11.56***  0.20 

0.91 

0.02 

2.45* 

•p  <  Hi. 
**p<  .os. 

•••p<  .01 


Table  6.  Mean  In  RMS  Deviation  Scores 

Motion  FOV _  _ Trlou 


Mu  sura 

On 

Ofl 

Full 

Umltad 

1 

2 

3 

4 

Takeoff 

Heading 

0.42 

0.57 

0.51 

0.49 

0.91 

0.56 

0.33 

0.19 

Altitude 

0.78 

0.88 

0.88 

0.79 

0.86 

0.93 

0.82 

0.70 

Climbpath 

5.50 

5.58 

5.52 

5.56 

5.59 

5.55 

5.56 

5.45 

Steep  Turn 

Airspeed 

1.52 

1.54 

1.56 

1.50 

1.81 

1.44 

141 

1  46 

Altitude 

4.35 

4.54 

4.37 

4.51 

4,74 

4.33 

4.36 

4.34 

Bank 

1.42 

1.32 

1.42 

1.32 

1.54 

1.35 

1.29 

1.30 

Slow  Flight 

Altitude 

4.16 

4  37 

4.20 

4.33 

4.77 

4.31 

1.07 

3  90 

Airspeed 

0.90 

1.01 

0.89 

1.01 

0.96 

1.13 

0.93 

0.77 

Heading 

1.54 

1.76 

1.56 

1.73 

2.14 

1.39 

1.57 

1.48 

Straight-ln  ( Before  Glidepath) 

Altitude 

3.71 

4.00 

3.78 

3.94 

4.18 

3.93 

3.71 

3.61 

Centerline 

4.66 

4  78 

4.70 

4.74 

4.84 

4.74 

4.70 

4.59 

Straight-ln  (On  Glidepath) 

Glidepath 

3.47 

3.88 

3.71 

3.65 

4.06 

3.84 

3.51 

3  29 

Centerline 

3.29 

3.57 

3.51 

3  35 

3.71 

3.36 

3.34 

3.31 

Airspeed 

0.93 

1.09 

0.95 

1.08 

1.45 

1.10 

0.76 

0.73 

F-ratios  were  also  significant -a  Motion  effect  for  Heading  Deviation  (p  <  .10)  and  a  three-way  interaction 
for  Attitude  Deviation  (p  <  .05).  For  Heading  Deviation,  the  Motion  group  had  smaller  scores  than  the  No 
Motion  group  at  each  measured  trial.  For  Pitch  Attitude  Deviation,  there  occurred  a  significant  decrease  in 
errors  for  only  one  condition,  Motion/Lirr.ited  FOV.  No  other  FOV  effects  were  obtained. 

For  the  Sleep  Turn,  a  significant  Trials  effect  was  obtained  for  each  parameter.  As  seen  in  Table  6, 
there  was  a  general  trend  for  both  groups  to  improve  in  performance  with  increasing  trials.  Altitude 
Deviation  was  also  significant  (p  <  .10)  for  tire  Motion  factor.  The  Motion  group  performed  better  than  the 
No  Motion  group  at  each  measured  trial.  No  FOV  effects  were  obtained. 

For  Slow  Flight,  significant  differences  were  obtained  for  the  Trials  effect  only.  As  shown  in  Table  5, 
these  differences  were  obtained  for  all  parameters.  Descriptive  data  indicate  generally  improved 
performance  across  the  four  trials.  No  Motion  or  FOV  effects  were  obtained. 

The  Straight -in  Landing  was  scored  in  two  separate  phases.  During  the  portion  before  intersection  of 
the  glidepath.  Altitude  Deviation  produced  statistically  significant  differences  for  both  Motion  (p  <  .05) 
and  Trials  (p  <  .01).  As  seen  in  Table  6,  the  Motion  group  performed  better  than  the  No  Motion  group  at 
each  measured  trial.  Also,  both  groups  improved  with  successive  trials.  The  second  phase  of  the  Straight -in 
Landing  was  scored  while  "on  glideslope."  As  shown  in  Table  5,  a  significant  Trials  effect  was  obtained  for 
each  parameter,  with  the  descriptive  data  indicating  improved  performance  over  the  trials.  For  the  Motion 
factor,  signi  icant  differences  were  obtained  for  Clidepath  Deviation  (p  <  .01)  and  Centerline  Deviation  (p 
<  .10),  with  the  Motion-trained  group  demonstrating  better  performance  in  each  case.  A  significant 
third-order  interaction  was  also  obtained  for  Airspeed  Deviations  (p  <  10).  However,  no  apparently 
meaningful  trends  emerged.  No  other  FOV  effects  were  obtained. 

APMS  Gtntrol  Input  Scores.  ANOVAs  for  control  input  score*  (In  RMS  movement  scores)  for  each  of 
the  maneuvers  are  presented  in  Table  7.  Descriptive  statistics  are  found  in  Table  8.  For  the  Takeoff,  a 
significant  Trials  effect  was  obtained  for  each  parameter.  Descriptive  data  in  Table  8  indicate  that  the  RMS 
scores  decreased  as  the  subjects  had  more  practice  on  the  maneuver.  A  significant  (p  <  .10)  Trials  by  FOV 
interaction  for  Elevator  movement  was  also  obtained.  A  rapid  decrease  in  movement  between  the  first  and 
second  trial  occurred  for  (he  Limited  FOV  groups,  while  the  decrease  for  the  Full  FOV  groups  was  more 
gradual. 

For  the  Steep  Turn,  the  Trials  main  effect  was  statistically  significant  for  each  of  the  control  input 
parameters.  The  descriptive  data  indicate  increased  Throttle  movement  over  the  four  trials  with  a  decrease 
in  other  control  movements,  especially  between  the  first  and  second  measured  trials. 

Data  were  recorded  for  two  separate  phases  of  the  Slow  Flight  maneuver.  During  the  portion  of  the 
maneuver  in  which  the  subjccls  were  configuring  the  ASPT,  a  significant  difference  between  the  Motion 
groups  was  obtained  for  Elevator  movement.  As  seen  in  Table  8,  the  Motion  groups  produced  higher 
Elevator  movement  scores  than  the  No  Motion  groups.  For  the  Trials  effect,  significant  univariate  ANOVAs 
were  obtained  for  Elevator  and  Throttle  movement.  During  that  portion  of  slow  flight  following 
configuration,  significant  FOV  differences  were  obtained  for  Elevator  movement,  with  greater  scores 
produced  in  the  limited  FOV  condition.  The  significant  Trials  effect  for  Aileron  control  was  produced  by 
decreased  movement,  especially  betv/een  the  first  and  second  measured  trials. 

The  Straight  -In  Landing  performance  was  also  scored  in  two  phases:  before  intersection  of  the 
glidepath  and  while  "on  glidepath.”  Before  intersection  of  the  glidepath,  the  Trials  main  effect  was 
statistically  significant  for  Aileron  and  Elevator  control  inputs  while  the  Motion  effect  was  significant  for 
Elevator  control.  Descriptive  data  indicate  that  both  the  Motion  and  No  Motion  groups  had  smaller  In  RMS 
Movement  Scores  with  successive  trials.  Also,  the  Motion  groups  had  higher  scores  than  the  No-Motion 
groups  at  each  trial.  In  the  ANOVAs  "on  glidepath,"  the  Trials  main  effect  was  again  significant  for  Aileron 
and  Elevator  control  inputs.  However,  for  the  Elevator  movements,  both  Motion  and  FOV  were  significant. 
Dcscripfive  data  revealed  that  the  Motion  groups  produced  higher  scores  than  the  No  Motion  groups  and 
that  all  groups  had  lower  scores  with  successive  trials.  Furthermore,  the  full-FOV  subjects  had  consistently 
lower  Elevator  control  scores  than  those  trained  with  the  limited  FOV. 
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Table  7.  F-valuc*  for  APMS  In  RMS  Movement  Data 


[  MNWI 

Motion 

Trtolt 

(M) 

FOV 

CT) 

M  x  FOV  M  k  T 

rov  iTNl  OOV  x  T  1 

TakeofT 

Aileron 

0.02 

1.20 

2.72**  0.00 

0 

Elevator 

0.80 

1.06 

23.23"*  0.25 

0 

Steep  Turn 

Aileron 

0.04 

1.46 

331"  0.12 

0 

Elevator 

1.09 

0.39 

13.40"*  0.42 

0 

Throttle 

0.78 

0.00 

3.96"  1.99 

0 

Slow  Fli|ht  (While  Configuring) 

Aileron 

0.00 

1.44 

1.88  2.29 

0 

Elevator 

7.00" 

2.22 

2.13*  0.06 

0 

Throttle 

0.01 

1.36 

2.12*  0.16 

0 

Slow  Flight  (After  Configuring) 

Aileron 

0.03 

0.58 

3.34**  0.07 

0 

Elevator 

0.97 

3.08* 

1.97  0.00 

0 

Straight-In  (Before  Glklepath) 

Aileron 

0.02 

008 

3.61"  0.02 

0 

Elevator 

9.13*** 

2.77 

9.42*"  0.07 

0 

Throttle 

0.04 

0.32 

1.11  0.01 

I 

Straight -In  (On  Glldepath) 

Aileron 

0.14 

0.00 

3.46"  003 

0 

Elevator 

6.96** 

3.74* 

17.21"*  0.24 

0 

Throttle 

0.12 

1 .30  1 .99 

0 

.  /y 

.18 

u. 

2: 

.55 

U 

,15 

0. 

.44 

1. 

i.24 

1. 

1.63 

1. 

1.68 

1. 

1.56 

1. 

.22 

1. 

.60 

1. 
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Table  8.  Mean  In  RMS  Movement  Scoiea 

i 

Takeoff 

1 

1 

Aileron 

2.76 

2.74 

2.82 

2.67 

332 

2.63 

2.79 

2.56  : 

i 

Elevator 

1.04 

0.96 

.96 

134 

1.40 

0.97 

0.73  i 

Steep  Tun 

l 

1 

Aileron 

2.58 

2.56 

2.64 

2.50 

2.84 

2.41 

2.62 

2.40 

1 

Elevator 

0.61 

0.54 

0.56 

0.60 

0.77 

0.54 

0.48 

0.51 

Throttle 

1.30 

137 

133 

1.33 

1.16 

133 

136 

1.48 

Slow  Flight  (During  Configuration) 

j 

i 

Aileron 

2.71 

2.71 

2.79 

2.63 

2.91 

2.60 

2.76 

2.58  i 

Elevator 

0.63 

0.41 

0.45 

0.58 

058 

0.50 

0.46  ! 

Throttle 

1.34 

1.35 

1.26 

1.43 

1.24 

1.45 

1.44 

1.24  ' 

i 

Slow  Flight  (After  Configuration) 

1 

1 

Aileron 

2.98 

2.96 

302 

2.93 

3.22 

2.84 

3.00 

2.82 

f 

Elevator 

0.46 

0.35 

031 

0.51 

0.51 

0.45 

0.32 

0.36 

I 

Straight-In  (Before  Glldepath) 

f 

Aileron 

2.43 

2.41 

2.43 

2.40 

2.65 

2.32 

2.45 

2.26 

£ 

Elevator 

0.38 

0.12 

0.18 

0.33 

038 

miMm 

0.16 

c 

Throttle 

133 

1.32 

1.30 

134 

1.25 

137 

1.35 

1.32  ! 

i 

Straight-In  (On  GUdepath) 

t 

Aileron 

2.33 

2.29 

2.32 

2.31 

2,52 

2.22 

235 

2.16 

t 

Elevator 

0.41 

0.17 

.20 

.28 

0.46 

0.30 

0.24 

0.16 

Throttle 

1.37 

1.36 

1.35 

138 

138 

1.42 

137 

1.30  j 

-  — >  —  im.V 

T*37  Evaluation  Data 


Of  primary  Interest  was  the  effect  which  Motion  and  FOV  in  the  ASPT  would  have  on  performance 
in  the  T-37.  For  each  maneuver,  a  series  of  two-factor,  completely  randomized  factorial  ANOVAs  were 
computed  using  information  from  the  special  data  cards.  The  results  of  these  ANOVAs  are  summarized  in 
Table  9,  with  descriptive  statistics  presented  in  Table  10. 


Tabic  9,  F-values  for  T-37  Evaluation  Scores 


Maaiura 

Motion  (M) 

FOV 

M  x  fOV 

Takeoff 

Pitch  Range 

.45 

3.42* 

3.42* 

Rotation  Speed 

5.83* 

.34 

.53 

Cround  Deviation 

.20 

.55 

1.08 

Liftoff  Deviation 

4.98* 

.03 

.10 

IP  Rating 

2.80 

.31 

.06 

Steep  Turn 

Altitude  Range 

.48 

.57 

.16 

Bank  Range 

.03 

1.56 

04 

Airspeed  Range 

.79 

.79 

.12 

IP  Rating 

2.38 

.00 

1.61 

Slow  Flight 

Altitude  Range 

.64 

22 

.15 

Airspeed  Range 

.00 

.00 

.00 

Heading  Range 

1.38 

.42 

1.63 

IP  Rating 

1.85 

.15 

.02 

Straight-In  (Before  Glidcpath) 

Altitude  Range 

1.70 

.19 

1.38 

Airspeed  Range 

.00 

2.66 

2.66 

Centerline  Deviation- 

1  .00 

.28 

- 

Straight-In  (On  Glidepalh) 

Altitude  Deviation 

.03 

.02 

.02 

Airspeed  Range 

.16 

.06 

2,03 

Centerlint  Deviation- 

1  2.25 

.05 

- 

IP  Rating 

.55 

.46 

22 

JC'biiquarcv 
•  p  <  .05. 


14 


Table  10.  Mean  T-37  Evaluation  Data 


Muan 

Motion 

_ JOY _ 

Mat  tow-On 

Matte  n-ON 

On 

Off 

Full 

klnllM 

Fu« 

UmHM 

PuH 

Takeoff 

Pitch  Range 

4.04 

4.47 

4.84 

3.67 

5.21 

2.87 

4.47 

4.47 

Rotation  Speed 

64.63 

68.25 

66.88 

66.00 

64.50 

64.75 

69.25 

67.25 

Ground  Deviation 

25.13 

28.61 

29.77 

23.97 

32.09 

18.17 

27.45 

29.77 

Liftoff  Deviation 

30.93 

57.41 

43.92 

45.23 

31.81 

30.15 

54.51 

60  31 

IP  Rating 

3.88 

2.56 

3.00 

3.44 

3.75 

4.00 

2.25 

2.88 

Steep  Turn 

Altitude  Range 

266.77 

308.86 

308.54 

264.30 

277.21 

256.33 

339.87 

273.42 

Bank  Range 

10.47 

10.78 

9.33 

12.00 

8.92 

12.03 

9.74 

11.97 

Airspeed  Range 

11.82 

13.92 

1 1.82 

13.92 

1033 

13.30 

1330 

14.62 

IP  Rating 

3.06 

1.93 

2.50 

2.53 

3.50 

2.63 

1.50 

2.43 

Slow  Flight 

Altitude  Range 

213.28 

257.50 

247.26 

221.25 

215.63 

210.94 

278.91 

233.04 

Airspeed  Range 

3.09 

3.06 

3.07 

3.04 

3.06 

3.11 

3.09 

3.02 

Heading  Range 

9.45 

13.38 

10.55 

12.21 

5.41 

13.49 

15.70 

10.74 

IP  Rating 

3.32 

2.27 

2.94 

2.67 

3.63 

3.00 

2.25 

2.29 

Straight-In  ( Before  Glkfcpath) 

Altitude  Range 

146.52 

175.28 

154.10 

165.10 

129.10 

163  93 

182.67 

166.67 

Airspeed  Range 

8.39 

8.67 

9.67 

7.28 

8.39 

8  39 

11.13 

5.80 

Centerline  Devjatiqp 

62.50 

61.54 

66.67 

57.14 

- 

- 

- 

Straight-In  (On  Glidepath) 

Altitude  Deviation 

64.58 

61.91 

62.15 

64  68 

62.50 

66.67 

61.81 

62.04 

Airspeed  Range 

7.14 

8.10 

7.73 

7.43 

6.05 

8.23 

9  41 

6.36 

Centerline  Deviation 

87.50 

64.29 

7,500 

78.57 

- 

- 

- 

- 

IP  Rating 

2.44 

1.93 

2.00 

2.43 

2.38 

2.50 

1.63 

2.33 

For  the  Steep  Turn,  Slow  Right,  and  the  Straight-In  Landing,  no  significant  effects  on  the  T-37 
evaluation  sortie  were  found  for  any  of  the  measures.  For  the  Takeoff,  significant  Motion  effects  were 
obtained  for  Rotation  Speed  and  Centerline  Deviation  following  Lift-off.  Rotation  Speed  was  found  to  be 
significantly  lower  for  the  Motion  groups.  Likewise,  Centerline  Deviations  following  Lift-off  were  smaller 
for  the  Motion-trained  groups.  Despite  these  effects,  the  overall  IP  rating  was  not  significant,  although  the 
trend  was  in  favor  of  the  Motion-trained  groups.  Significant  FOV  and  Motion  by  FOV  effects  were  also 
obtained  for  Pitch  Range.  Descriptive  data  revealed  a  smaller  Pitch  Range  for  the  Limited  FOV  groups 
under  conditions  of  motion  cueing.  No  FOV  effects  were  obtained  for  the  No  Motion  condition. 


IV.  DISCUSSION 

For  data  collected  in  the  simulator,  two  questions  were  of  interest.  The  first  was  whether  learning 
occurred  during  simulator  training.  The  second  was  whether  any  differential  skill  acquisition  effects  were 
apparent  as  a  result  of  Motion,  FOV,  or  their  interaction.  With  respect  to  the  first  question,  the  data  are 
clear  Student  performance  improved  significantly  across  the  four  trials  as  measured  by  IP  ratings,  as  well  as 
scores  from  the  APMS.  The  IP  ratings  significantly  increased,  while  error  scores  from  the  APMS  decreased 

To  answer  the  second  question  and  conclude  that  Motion.  FOV,  or  their  interaction  affects  skill 
acquisition  in  the  simulator,  it  is  necessary  to  demonstrate  learning  curve  differences  among  the  groups.  In 
other  words,  significant  interactions  effects  with  the  Trials  factor  must  occur.  For  the  IP  ratings,  no  such 
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Interactions  occurred.  Two  significant  third-order  (Motion  x  FOV  x  Trials)  interactions  were  obtained  using 
the  APMS  error  scores.  For  Pitch  Attitude  error  during  Takeoff,  only  the  Motion/Limited  FOV  group 
showed  significant  improvement  during  simulator  training.  None  of  the  remaining  groups  improved  their 
performance.  For  Airspeed  error  on  the  Straight-ln,  no  meaningful  trends  were  observed.  Thus,  there  is 
little  evidence  that  Motion,  FOV,  or  their  interaction  significantly  affected  skill  acquisition  in  the 
simulator. 

Significant  performance  differences  did  occur,  however,  among  the  groups  during  simulator  training 
for  the  Motion  factor.  Using  IP  ratings,  significant  motion  effects  were  obtained  on  three  maneuvers: 
Takeoff.  Slow  Right,  and  Straight-In  Landing.  As  evidenced  by  the  descriptive  data,  the  Motion-trained 
groups  received  higher  ratings  for  each  measured  trial  on  these  three  maneuvers  and  for  three  of  the  four 
measured  trials  on  the  Steep  Turn.  Likewise,  five  of  the  14  error  scores  from  the  APMS  produced 
significant  motion  effects.  Consistent  differences  across  the  four  trials  were  observed,  with  lower  error 
scores  being  produced  by  the  Motion  groups.  Since  these  differences  were  consistent  across  all  measured 
trials  and  there  occurred  no  significant  Motion  by  Trials  interaction,  it  is  clear  that  performance,  rather 
than  learning,  was  impacted.  Unfortunately,  the  underlying  reason  for  these  differences  is  unknown  and 
cannot  be  determined  from  the  data:  however,  a  discussion  of  possible  explanations  seems  warranted. 

The  most  obvious  explanation  is  that  platform  motion  cueing  produced  the  observed  differences: 
however,  such  results  are  contradictory  to  previous  study  findings  using  the  ASPT  with  student  pilots 
(Martin  &  Waag,  1978a;  1978b),  as  well  as  with  experienced  pilots  (Irish  &.  Buckland,  197x.  Irish,  Grunzke. 
Cray,  &  Waters,  1977).  Second,  it  is  possible  that  there  existed  initial  group  differences  which  accounted 
for  the  better  performance  of  the  Motion  groups,  although  the  likelihood  of  such  an  occurrence  should  be 
small,  given  the  sample  size.  Third,  it  is  possible  that  there  may  have  existed  some  IP  bias.  However,  this 
explanation  is  also  unlikely  since  differences  were  obtained  using  the  objective  APMS  error  scores.  Thus,  it 
seems  that  each  of  the  potential  explanations  is  not  completely  satisfactory. 

As  indicated  earlier,  control  input  data  are  not  directly  related  to  proficiency.  However,  they  do 
provide  information  on  control  strategy  as  affected  by  various  simulator  configurations.  Three  measures  of 
control  activity  were  analyzed:  RMS  movement  for  Elevator  (Y-axis).  Aileron  (X-axis),  and  Throttle.  The 
most  striking  finding  is  the  relatively  large  amount  of  control  activity  in  the  X-axis  (aileron),  which  would 
confirm  the  excessive  “roll  sensitivity"  reported  by  pilots  flying  the  ASPT. 

The  most  consistent  finding  using  these  control  input  measures  was  a  significant  Trials  effect. 
Descriptive  data  indicated  a  decreased  amount  of  Elevator  and  Aileron  movement  and  an  increased  amount 
of  Throttle  movement.  With  respect  to  Motion  and  FOV,  the  only  measure  to  yield  significant  effects  was 
Elevator  movement.  With  regard  to  Motion,  significant  effects  were  obtained  for  Slow  Flight  while 
configuring  and  for  both  phases  of  the  Straight-ln  Landing.  Students  in  the  Motion-trained  groups  produced 
more  Elevator  Movement,  a  finding  consistent  with  previous  efforts  using  experienced  pilots  in  the  ASPT 
(Irish  &.  Buckland,  1978;  Irish  et  al,  1977).  Significant  FOV  effects  were  obtained  for  Slow  Flight  after 
configuration  and  the  glidepath  portion  of  the  Straight-ln  Landing.  The  limited  FOV  condition  produced 
greater  movement.  Thus,  it  would  appear  that  the  addition  of  plstform  motion  cueing  and  the  use  of  a 
narrow  FOV  visual  system  increases  the  amount  of  elevator  control  activity.  These  effects  are  most 
pronounced  whenever  the  simulated  aircraft’s  stability  is  decreased  during  configuration  changes  necessary 
for  landing  and  during  the  final  approach  itself. 

For  transfer-of-training  data  collected  in  the  aircraft,  neither  Motion,  FOV,  nor  their  interaction 
during  simulator  training  differentially  affected  performance  as  measured  by  IP  ratings.  There  was  a  trend 
toward  better  performance  by  the  Motion-trained  groups.  Of  the  16  parameters  recorded  by  the  IPs  on  the 
special  data  cards,  two  produced  significant  Motion  effects,  Both  occurred  during  the  Takeoff-Rotation 
Speed  and  Centerline  Deviation  Range  following  Liftoff.  A  significant  Motion  by  FOV  interaction  for  Pitch 
Range,  with  lower  scores  under  the  Limited  FOV  condition  occurred  whenever  the  platform  motion  system 
was  operative.  Thus,  of  the  58  statistical  tests  computed  on  the  aircraft  evaluation  data,  only  three 
produced  significant  effects.  The  extent  to  which  these  represent  real  effects  Is  unknown,  since  the 
probability  of  significant  differences  given  the  number  of  tests  is  quite  high. 
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It  is  possible,  however,  to  compare  these  aircraft  differences  with  data  collected  during  ASPT 
training.  In  the  event  the  results  are  consistent,  greater  confidence  could  be  placed  on  the  conclusion  that 
the  effects  are  real.  For  Rotation  Speed  during  Takeoff,  the  simulator  data  revealed  no  significant  effects 
due  to  Motion.  By  the  fourth  trial,  average  Rotation-Speed  across  the  four  groups  varied  by  less  than  one 
knot.  For  Centerline  Deviation  Range  following  Lift-off,  a  significant  effect  due  to  Motion  occurred, 
although  RMS  heading  error  showed  no  differences.  For  Pitch  Attitude  Range,  a  third-order  interaction  was 
obtained  in  which  only  the  Motion/Limited  FOV  group  showed  significant  improvement.  Similar  findings 
were  obtained  for  RMS  Pitch  Attitude  error.  Thus,  of  the  two  measures  producing  significant  Motion 
effects  in  the  aircraft,  only  one  showed  similar  effects  in  the  simulator.  Likewise,  the  one  significant  Motion 
by  FOV  interaction  in  the  aircraft  was  also  significant  in  the  simulator.  However,  it  is  curious  why  three  of 
the  four  groups  showed  no  improvement  during  simulator  training  on  this  measure. 

A  major  criterion  for  accepting  the  findings  of  any  differential  transfer  is  the  demonstration  that 
transfer  of  learning  did  in  fact  occur.  The  present  study  did  not  include  a  control  group,  so  this  question 
cannot  be  answered  unequivocally.  Current  Air  Training  Command  requirements  prohibit  the  students  from 
flying  the  maneuvers  in  the  T-37  before  they  are  demonstrated  by  the  IP.  The  additional  training  in  the 
ASPT  enabled  a  waiver  on  that  requirement  for  the  experimental  groups.  However,  it  was  not  possible  to 
evaluate  the  performance  of  a  control  group  in  the  aircraft. 

Despite  the  lack  of  control  group  data,  there  are  good  reasons  to  “assume"  that  transfer  of  learning 
did  occur.  First,  significant  improvements  in  simulator  performance  were  obtained.  On  the  last  simulator 
sortie,  average  performance  leveb  were  in  the  "Good"  range  for  all  maneuvers.  Furthermore,  there  is 
evidence  that  student  performance  leveb  had  stabilized  by  the  last  sortie.  Statistical  tests  revealed  no 
significant  improvements  in  performance  between  the  third  and  fourth  sorties  as  measured  bv  IP  ratings.  In 
addition  to  the  demonstration  of  learning  in  the  simulator,  addit.onal  support  for  assuming  positive  transfer 
can  be  derived  from  previous  research  results.  With  few  exceptions,  positive  transfer  of  learning  has  been 
demonstrated  for  these  transition  tasks  for  every  class  of  aircraft  (trainer,  fighter,  transport).  Furthermore, 
there  is  specific  evidence  that  such  training  in  the  ASPT  transfers  to  the  T-37  aircraft  (Martin  &  Waag. 
1978a;  Woodruff  ct  al.,  1976).  Therefore  it  seems  likely  that  positive  tr.nsfer  did  occur.  Furthermore,  a 
look  at  the  data  recorded  in  the  aircraft  revealed  that  most  parameters  are  within  the  Good  to  Excellent 
category  as  defined  by  the  criteria  on  the  special  data  cards. 

Aside  from  the  lack  of  control  group  data,  there  occurred  other  problems  which  are  characteristic  of 
most  transfer-of-training  evaluations  These  have  been  described  in  detail  by  Martin  and  Waag  (1978a. 
1978b)  so  that  further  discussion  seems  unwarranted.  The  one  aspect  of  the  study  where  comment  does 
seem  appropriate  is  in  the  area  of  task  selection;  that  is,  whether  the  tasks  selected  for  training  were 
appropriate  to  the  questions  being  asked.  It  can  be  argued  that  none  of  the  tasks  require  peripheral  visual 
cues  so  that  the  FOV  question  is  not  properly  addressed.  With  respect  to  motion,  the  distinction  between 
maneuver  cueing  and  disturbance  cueing  has  recently  been  investigated  (Caro,  1977).  Accordingly,  there  are 
data  to  suggest  that  platform  motion  cueing  becomes  a  critical  variable  only  for  tasks  having  a  large 
disturbance  component.  Since  the  tasks  selected  for  the  present  study  provide  little  disturbance  cueing 
information  (e  g.,  slow  flight  and  the  change  of  configuration  during  the  straight-in  landing),  it  may  be 
argued  that  the  motion  question  is  not  properly  addressed. 

It  is  agreed  that  such  arguments  have  merit  when  one  attempts  to  answer  the  general  question  of 
motion  and  visual  cueing  requirements.  However,  as  stated  at  the  outset,  the  intent  of  the  present  series  of 
studies  was  to  address  a  very  specific  and  limited  question — the  effectiveness  of  platform  motion  cueing 
for  naive  UPT  students  transitioning  into  the  T-37  aircraft.  For  this  reason,  tasks  were  selected  which  are 
normally  taught  in  the  T-37  training  program.  Very  few  tasks  in  the  T-37  training  syllabus  provide 
significant  disturbance  cues.  Only  stalls  are  currently  being  trained  In  the  new  Air  Training  Command 
Instrument  Flight  Simulator.  For  these  maneuvers,  it  has  been  demonstrated  that  requiring  the  IP  to 
manually  shake  the  stick  was  as  effective  as  platform  motion  in  providing  the  stall  onset  cues  (Martin  & 
Waag,  1978a).  For  these  reasons,  the  tasks  selected  seem  adequate  to  address  the  motion  issue  posed  at  the 
outset.  With  respect  to  fleld-of-view,  the  question  posed  was  whether  the  addition  of  platform  motion 
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cueing  enhanced  the  effectiveness  of  training  with  a  limited  FOV  visual  environment.  The  use  of  tasks 
normally  trained  using  a  narrow  FOV  system  seemed  most  appropriate  to  answer  this  question. 


V.  CONCLUSIONS 

The  data  from  the  present  study  warrant  the  following  conclusions. 

1 .  No  firm  evidence  of  differential  transfer  effects  resulting  from  platform  motion  cueing,  size  of  the 
visual  FOV,  or  their  interaction  was  obtained;  as  such,  these  data  provide  support  for  previous  findings  that 
platform  motion  cueing  does  not  significantly  enhance  the  transfer  of  teaming  for  basic  contact  tasks  in  the 
T-37  aircraft. 

2.  It  would  seem  that  the  impact  of  peripheral  visual  cues  for  initial  acquisition  is  not  critical: 
furthermore,  no  convincing  evidence  was  found  indicating  increased  transfer  using  platform  motion  in 
conjunction  with  a  narrow  FCV  visual  seme. 

3.  In  addition  to  the  lack  of  differential  transfer  to  the  aircraft,  there  also  occurred  no  differential 
effects  upon  learning  in  the  simulator. 

4.  Performance  differences  in  the  simulator  did  occur  although  the  underlying  reason  is  unclear;  for 
certain  measures,  the  motion  group  performed  consistently  better  on  all  measured  trials,  including  the  first. 

5.  It  seems  reasonable  to  conclude  (hat.  taken  as  a  whole,  no  substantial  or  practical  differences  in 
training  effectiveness  resulted  from  manipulations  of  platform  motion  cueing  and  the  FOV  of  the  visual 
scene. 
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APPENDIX  A:  PRE-FLIGHT  BRIEFING 


Welcome  to  the  Air  Force  Human  Resources  Laboratory  (AFHRL).  This  is  the  simulator  pre-flight 
briefing  for  the  HRL  VISMO  study.  V1SMO  is  an  acronym  for  Visual  in  Motion  Configuration  Changes. 
(Kinda  catchy  isn't  it?)  In  this  phase  of  the  Study,  you  will  be  receiving  four  simulator  flights  and  one  flight 
In  the  T-37,  during  which  time  you  will  team  normal  takeoffs,  straight-ins  and  landings,  steep  turns,  and 
slow  flight.  During  the  early  part  of  each  sortie,  you  will  first  review  a  demonstration  of  each  one  of  the 
four  maneuvers.  After  that,  you  will  have  several  practice  repetitions.  Following  the  practice  session,  there 
will  be  a  data -collection  period  where  we  will  assess  your  ability  to  perform  the  maneuver.  Do  your  best  at 
all  times,  because  this  will  not  only  make  each  maneuver  more  meaningful  for  you,  but  it  will  also  provide 
us  with  the  most  valid  data  for  our  review. 

Let’s  first  discuss  the  various  techniques  for  each  one  of  the  four  maneuvers,  and  the  first  one  we  will 
cover  is  the  normal  takeoff.  The  first  thing  I  would  like  you  to  note  is  where  the  horizon  falls  in  the 
windscreen.  You  notice  here  that  it  cuts  halfway  through  the  windscreen.  From  your  seat  position,  you 
should  be  able  to  look  right  through  the  center  of  the  windscreen  and  see  half  sky  and  half  ground.  Prior  to 
initiating  the  takeoff,  you  will  pump  up  the  brakes  and  perform  the  normal  lineup  check. 

After  checking  the  instruments  good,  you  will  engage  the  nosewheel  steering  on  the  front  of  the  stick 
grip-a  little  red  button  right  on  the  front.  Then,  you  will  release  the  brakes.  Remember  to  release  the 
brakes  evenly  and  initiate  the  takeoff  roll.  You  use  the  nosewheel  steering  and  the  rudder  pedals  to  keep 
the  aircraft  on  the  center  line  of  the  runway.  At  approximately  65  knots,  you  release  the  nosewheel 
steering  and  raise  the  nose  to  establish  the  takeoff  attitude.  You  simply  do  this  by  pulling  back  on  the  stick 
a  slight  amount.  Note  the  new  position  of  the  horizon  in  the  windscreen  here.  This  picture  corresponds  to  a 
5°  pitch  attitude -the  same  attitude  you  would  see  if  you  had  5°  on  the  attitude  indicator.  By  maintaining 
this  attitude,  the  aircraft  should  lift  off  at  approximately  90  knots.  As  the  aircraft  leaves  the  runway,  you 
will  maintain  the  wings  level  by  controlling  the  ailerons.  There  is  a  natural  tendency  to  rock  the  wings.  Let  s 
try  to  avoid  that  by  controlling  it  with  the  ailerons.  At  100  knots  and  the  engine  instruments  checked  good, 
retract  the  gear  by  raising  the  handle  with  your  left  hand.  At  1 10  knots,  retract  the  flaps  by  pushing  the 
flap  lever  all  the  way  to  the  top.  Now,  raising  the  flaps  will  cause  a  slight  loss  of  lift  for  which  you  wfll 
compensate  by  pulling  back  on  the  stick  and  trimming  off  the  pressure.  As  the  airspeed  increases,  trim  off 
all  the  stick  forces  that  will  build  up  as  a  result  of  the  increased  airspeed .  Once  the  gear  and  flaps  have  been 
retracted,  maintain  the  500  to  1000  feet  per  minute  on  the  vertical  velocity  until  you're  ready  to  turn  on 
the  traffic.  The  takeoff  is  a  critical  phase  of  flight  requiring  the  utmost  attention  of  you,  the  pilot,  at  all 
times.  You  must  be  constantly  alert  for  the  sudden  loss  of  thrust  due  to  engine  failure  or  some  other 
catastrophe,  to  make  sure  that  you  are  flying  as  safely  as  possible  at  all  times. 

The  next  maneuver  will  be  the  steep  turn.  This  maneuver  should  be  entered  from  a  fully-trimmed 
condition  in  straight  and  level  flight  at  a  160  knots.  And,  of  course,  the  simulator  will  be  given  to  you  in 
that  condition  all  the  time.  Remember  that  during  the  60°  bank  turn  that  you  will  being  flying, 
approximately  2g  is  required  to  maintain  a  level  turn -that  is  to  maintain  your  altitude.  Although  the  g 
forces  in  the  airplane  are  much  more  apparent  than  they  arc  in  the  simulator,  be  aware  that  the  stick  force 
you  will  have  to  use  in  the  simulator  will  be  the  same.  Always  begin  the  roll-in  slowly,  and  as  you  pass 
through  30°  bank,  you  gently  begin  to  increase  the  back  pressure  and  add  the  power,  as  required,  to 
maintain  altitude  and  airspeed.  The  back  ptessure  required,  and  the  back  pressure  that  you  have  to  put  in. 
will  cause  increased  drag  and  that's  what  causes  the  airspeed  to  slow  down.  You  counterbalance  the  loss  of 
airspeed  by  adding  enough  power  to  keep  the  airspeed  right  at  160  knots.  Now,  as  you  approach  60°  of 
bank,  continue  to  monitor  the  airspeed  while  increasing  the  back  pressure.  It's  an  ever  smooth  increasing 
back  pressure  all  the  way  to  the  max  bank  angle.  Use  the  horizon  line  depicted  here,  as  well  as  the  attitude 
indicator  to  maintain  your  pitch  and  your  bank  references.  When  rolling  out  of  the  turn,  decrease  the  back 
pressure  and  reduce  the  power  to  the  appropriate  setting  that  you  had  in  straight-and-level  flight.  Continue 
to  use  the  horizon  and  the  attitude  indicator  for  pitch  and  bank  information  even  after  you've  rolled  out. 
because  you  are  going  to  roll  out  to  straight-and-level  (light.  Remember  to  monitor  the  airspeed.  The 


rollout  should  ult iiiiately  return  the  aiicraft  to  the  seme  conditions  as  at  the  beginning,  except  for  the 
heading  change  that  you  made  while  you  were  in  the  turn. 

The  next  maneuver  is  called  slow  flight.  This  is  a  little  more  difficult  maneuver.  Prior  to  entering  this 
maneuver,  the  aircraft  should  be  again  stable,  trimmed,  slraigh'-and-level  flight,  at  160  knots.  Also,  your 
instructor  will  hand  you  the  simulator  controls  in  this  condition.  To  begin,  lower  the  speed  brake  and 
reduce  the  power.  This  will  begin  to  slow  the  airplane  down  toward  the  target  airspeed  of  75  to  80  knots. 
Maintain  the  altitude  by  pulling  back  a  slight  amount  on  the  stick,  as  necessary,  and  raising  the  nose  to 
compensate  for  the  decreasing  airspeed.  What  that  means  is,  as  the  airspeed  depletes,  the  nose  w  ill  want  to 
drop,  and  you  will  have  to  keep  it  up  by  pulling  back  on  the  stick  slightly.  When  the  airspeed  drops  below 
150  knots,  lower  the  gear.  Remember  to  hold  altitude  with  pitch  control.  When  the  airspeed  drops  below 
135  knots,  lower  full  flaps  by  pushing  the  flap  lever  to  the  full-down  position.  This  is  the  final 
configuration  change.  In  other  words,  we  won’t  change  She  configuration  anymore  during  this  maneuver. 
By  this  time,  the  airspeed  will  probably  be  very  close  to  the  desired  airspeed,  thal  is,  75  to  80  knots.  You 
continue  to  hold  the  nose  upas  necessary  to  maintain  altitude  and  trim  to  relieve  the  undesired  stick  forces 
tha"  will  occur  from  the  rapidly  depleting  airspeed.  Prior  to  the  airspeed  actually  reaching  75  to  80  knots, 
you  are  going  to  have  to  lead  the  power:  that  is.  at  about  82  to  83  knots  or  so,  push  the  power  into 
approximately  90  percent.  This  will  prevent  the  airspeed  from  dropping  below  75  knots  and  causing  the 
airplane  to  stall  When  you  have  the  aircraft  stabilized  at  straight -and -level,  and  at  fully  trimmed  condition, 
nose  high,  and  75  to  80  knots,  you  are  in  slow  flight:  and.  while  you  are  in  slow  (light,  you  will  be  expected 
to  maintain  heading,  altitude,  and  airspeed.  You  won't  do  any  coordinated  turns  or  any  other  maneuvers  of 
that  nature.  Now,  I  would  like  you  to  notice  the  relative  position  of  the  horizon  in  the  wind  screen  during 
the  slow  flight  maneuver.  The  pilch  attitude  is  very  very  high.  You  can  see  here  that  the  horuon  is  resting 
just  on  top  of  the  wind  Sueen.  The  siow  flight  maneuver  was  designed  to  acquaint  you  with  the 
characteristics  of  the  airplane  when  flying  at  minimum  controllable  airspeeds.  This  is  similar  to  the 
conditions  that  you  might  encounter  after  initially  initiating  Ihe  go-around. 

Now,  the  next  maneuver  will  be  the  straight-in  approach  and  landing.  The  siraiglil-in  approach  will  be 
started  at  approximately  5  miles  from  the  runway  5000  feet  above  the  ground  and  at  about  I  50  knots.  The 
power  will  be  set  at  about  70  percent -plus  or  minus  some  small  amount.  You  will  be  required  to  make  the 
radio  calls;  the  appropriate  calls  at  the  5-  and  the  2-mile  points.  Your  instructor  will  tell  you  what  thev  are. 
where  they  are,  and  where  they  should  occur.  To  initiate  the  approach,  make  sure  the  airspeed  initially  is 
below  150  knots.  When  it  is.  then  you  lower  the  gear  handle  and  make  all  the  gear-down  checks.  At  135 
knots  or  below,  you  will  lower  the  flap  handle  to  the  full-down  position,  and  also  the  landing  lights.  As  the 
airspeed  decreases,  you  will  have  to  add  back-pressure  to  maintain  the  desired  altitude  and  trim  off  the 
undesired  stick  forces  that  will  result.  This  Is  done  in  much  the  same  manner  as  you  did  in  slow  flight.  In 
other  words,  the  airplane  is  slowing  down,  the  nose  is  coming  up,  and  you  arc  trimming  off  lire  pressure. 
The  main  difference  here,  of  course,  is  the  fact  that  you’re  not  going  to  slow  down  to  75  to  80  knots.  You 
are  going  to  reduce  your  airspeed  to  100  knots.  Also,  Ihe  speedbrake  in  the  straight-in  approach  Is  not  used 
until  we  initiate  the  glidcpatli.  Now,  also,  like  in  slow-flighl,  as  the  airspeed  reaches  the  desired  airspeed 
(thal  is,  again  100  kno(s),  you  will  have  to  add  power  to  approximately  80  percent,  in  oilier  words,  leading 
the  power.  To  maintain  ihe  airspeed  and  the  altitude,  always  align  with  the  centerline  of  Ihe  runway  until 
you  are  approximately  1-1/4  miles  from  the  runway.  At  this  point .  you  are  going  to  extend  speedbrake  by 
sliding  back  the  slide  switch  on  the  left  throttle,  reduce  the  power  slightly,  and  set  up  a  glidepath.  Now.  as 
you  enter  the  glidepath,  you  will  begin  a  descent  to  the  runway.  You  select  the  aim  point  and  the  most 
common  technique  for  doing  this  is  to  lower  the  nose  until  the  aim  point,  that,  the  runway  threshold,  is 
right  in  the  middle  of  the  windscreen.  This  is  the  same  location  thal  lire  horizon  would  be  in  a 
st raight -and-level  flight.  Here  you  will  noiice  that  the  runway  is  just  about  in  the  middle  of  your 
windscreen.  You  continue  to  fly  the  airplane  down  towards  your  aim  point  maintaining  100  knots  and  the 
centerline  of  the  runway  wiih  your  bank  conlrol.  If  you  are  on  the  proper  glidepath,  the  aircraft  will  pass 
Ihrough  1700  feet  indicated  at  3/4  mile  from  the  runway.  Be  particularly  aware  of  all  the  signs  lhat  may 
indicate  to  you  an  engine  failure,  because  again  this,  like  the  takeoff,  is  a  critical  phase  of  flight.  It  is  very 
important  that  you  are  tuned  to  this  possibility  at  all  times,  Now,  as  the  aircraft  approaches  the  runway 


touchdown  zone,  you  will  smoothly  reduce  the  power  and  gently  puO  back  on  the  stick,  gently  raising  the 
nose  to  establish  the  landing  attitude.  The  aircraft  will  touch  down  at  approximately  75  to  80  knots  (the 
same  airspeed  you  use  for  slow-flight).  You  should  plan  the  touchdown  so  that  It  occurs  in  the  first  1000 
feet  of  the  runway.  Once  you  are  on  the  runwa> .  you  continue  to  hold  the  nosewheel  up  off  the  ground  by 
keeping  the  stick  a  little  bit  back  toward  your  lap  until  the  elevator  loses  its  control  effectiveness.  Now  this 
is  going  to  occur  at  about  60  to  65  knots.  After  lowering  the  nosewheel  to  the  runway,  and  you  simply  do 
that  by  pushing  the  stick  forward  and  letting  the  nosewheel  touch  (and  you’ll  feel  it),  then  you  will  retract 
the  speed  brake.  The  rudder  will  lose  its  effectiveness  at  approximately  SO  knots,  so  at  this  point,  you  will 
engage  the  nosewheel  steering  after  you  check  the  rudder  pedals  neutral  and  maintain  your  directional 
control  down  the  centerline  of  the  runway  using  the  rudder  pedals  and  the  nosewheel  steering.  Before 
reaching  the  end  of  the  runway,  gently  touch  the  brakes  to  insure  proper  operation.  When  I  say  gently,  I 
mean  just  that.  Don't  push  them  so  hard  you  get  a  gigantic  lurch  in  the  airplane,  lust  push  them  a  small 
amount  so  you  feel  a  little  resistance.  You  see,  the  brakes  not  only  are  used  for  normal  stopping,  but  they 
can  be  used  for  emergency  turning  if  the  need  arises. 

Well,  this  concludes  the  pre-flight  briefing  for  Phase  1  of  the  AFHRL  VISMO  Study.  I  hope  1  haven’t 
bored  you  too  much.  No,  seriously,  if  you  have  any  questions,  feel  free  to  ask  your  instructor  pilot  or  any 
of  the  research  investigators  that  are  on  site  at  the  simulator  area.  Good  luck  to  you,  and  when  you  come 
over  here,  I’m  sure  you  will  have  a  good  time.  Enjoy  yourself! 
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APPENDIX  B  SPECIAL  DATA  CARD  DEVELOPMENT 


An  initial  draft  grading  form  was  prepared  for  each  maneuver.  Although  the  straight-in  and  landing 
were  flown  as  a  single  continuous  maneuver,  two  grading  forms  were  prepared.  The  first  form  included  that 
portion  of  the  maneuver  prior  to  interception  of  the  glidepath.  The  second  form  included  the  segment  from 
interception  of  the  glidepath  until  touchdown.  These  initial  draft  grading  forms  were  then  reviewed  by 
several  Instructor  Pilots  (IPs).  Based  on  the  comments  which  were  made,  the  initial  grade  sheets  were 
revised.  The  next  phase  of  score  sheet  development  involved  their  actual  use  in  the  evaluation  of  recorded 
flight  performance.  Two  (lights  were  recorded  for  each  maneuver.  One  of  them  was  representative  of  "fair" 
performance;  the  other  was  representative  of  "good"  performance.  Each  IP  evaluated  all  eight  recorded 
flights  with  the  initial  score  sheets.  The  next  day.  the  IPs  were  shown  how  each  of  them  had  evaluated  the 
respective  recorded  (lights.  The  IPs  also  presented  and  discussed  ways  in  which  the  score  sheets  could  be 
improved. 

Based  on  comments  by  the  IPs.  the  score  sheets  were  again  revised.  These  score  sheets  were  used  to 
evaluate  a  second  set  of  eight  recorded  flight  performances.  The  score  sheets  were  again  revised  on  the  basis 
of  in-depth  comments  from  the  IPs  That  revision  of  the  score  sheets  was  used  to  evaluate  the  second  set  of 
recorded  flight  performance  one  more  time.  After  the  in-depth  discussion  with  the  IPs,  the  score  sheets 
were  revised  for  the  last  time.  These  final  score  sheets  arc  presented  in  Figures  Bl  to  B4. 

The  validity  of  (he  score  sheets  was  assessed  in  conjunction  with  the  data  collection  phase  of  the 
study.  The  final  score  sheets  were  reproduced  on  5!6  x  lOVi  inch  ( 1 3.97  x  26.67  cm)  cards.  The  score  sheets 
were  validated  by  correlating  the  corresponding  scores  between  the  IP  and  Automated  Performance 
Measurement  System  (APMS)  evaluations  of  both  specific  parameters  and  overall  evaluations.  Each  IP 
evaluated  eight  students  for  four  trials  on  each  of  the  foui  maneuvers.  Simultaneous  evaluations  were 
accomplished  by  the  APMS. 

The  range  of  the  correlations  between  the  IP  and  APMS  evaluations  of  the  flight  parameters  in  the 
ASPT  (Table  Bl )  was  .168  to  .960  with  a  median  of  .763.  The  lowest  correlation  was  significant  at  p  < 
.055;  three  of  the  correlations  were  significant  at  p  <  .001;  and  the  remaining  25  correlations  were  all 
significant  at  p  <  .0001.  The  differences  in  degrees  of  freedom  were  due  to  occasional  system  failures  which 
precluded  the  completion  of  some  measured  trials. 

For  the  takeoff,  the  minimum  pitch  correlation  (f  =  .168)  was  quite  low.  This  possibly  was  due  to  t lie 
fact  that  the  IPs  initiated  scoring  of  that  parameter  sooner  than  the  APMS  The  IPs  started  scoring  pilch  as 
soon  as  the  students  attempted  to  establish  a  takeoff  attitude;  desired  rotation  speed  was  65  KIAS.  In 
contrast,  the  APMS  did  not  initiate  scoring  that  parameter  until  airspeed  reached  a  minimum  of  75  KIAS. 
The  novice  student  tended  to  be  erratic  as  they  established  a  takeoli' attitude.  Some  of  them  would  have  a 
few  moments  with  relatively  low  pitch  angle  while  the  IPs  were  evaluating  their  performances,  but  before 
the  APMS  initiated  the  scoring  of  that  parameter.  Perhaps  it  was  the  erratic  pitch  control  immediately  alter 
takeoff  which  caused  the  low  correlation  for  minimum  pitch.  Nonetheless,  the  range  of  takeoff  correlations 
was  .168  to  .763  and  the  median  was  .551. 

All  but  one  of  the  parameters  in  the  steep  turn  had  correlations  above  .60,  the  range  was  .481  to  .946 
and  the  median  was  .878.  Every  parameter  was  statistically  significant  at  p  <  .000).  Although  the  median 
slow  flight  correlation  was  slightly  less  (.818),  the  correlation  for  every  parameter  was  greater  Ilian  .60:  (lie 
range  was  .602  to  .925.  Once  again,  every'  parameter  reached  statistical  significance  at  p  <  .0001 .  For  the 
straight-in  and  landing,  half  of  the  correlations  were  above  .60.  The  range  of  coi  relations  W3S  .308  to  .960; 
the  median  was  .701.  Three  were  statistically  significant  at  p  <  .00).  while  the  remaining  were  at  p  < 
.0001. 

The  results  of  the  validation  effort  clearly  indicate  the  ability  of  IPs  to  accurately  record  both  the 
maximum  and  the  minimum  values  of  multiple  parameters  throughout  the  performance  of  these  maneuvers. 
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In  arriving  at  an  overall  rating,  IP's  should  consider  In  addition  to  those 
item*  abova,  timeliness  of  corrections,  smoothness.  power  control,  and  propar 
configuration. 

OVERALL  PATINA 


form 
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ONE  TIME 

Figure  Rl .  Takeoff  score  sheet. 


EXPIRES:  SEP  77 


ll 


60  DEGREE  STEEP  TURN  J 

STUDENT  _  INSTRUCTOR  _ 

MISSION  _  _  DATE _ HINDS 


ALTITUDE 

DEVIATION 

300'  — 

200'  — 

100'  — 


-100'  — 
-200'  ~ 
300'  — 


BANK  ANGLE 

75  70  65  60  SS  50  45 

J _ I _ I _ I _ i _ i _ L 

AIRSPEED  DEVIATION 

14SK  150K  155K  160K  165K  170K  175K 

J _ I _ 1 _ I _ I _ I _ L 


CRITERIA 


F 

^250 ' 

altituoe 

G 

♦  150 

E 

♦  IOO' 

F 

♦  12 

SANK  ANGLE 

G 

♦10 

i 

♦s 

AIRSPEEO 

F 

G 

£ 

160  k 

160k 

160k 

♦12k 

♦8k 

♦5k 

In  arriving  at  an  overall  rat'ng,  IP's  should  consider  In  addition  to  those 
Items  above,  timeliness  of  corrections,  smoothness,  power  control  and  proper 
configuration. 


OVERALL  RATING 

1  2  3  4  5  6  7  8 

cp  C=^=)  e=c=?=>  cp 


Form 

AfHRL  124  ONE  TIME  EXPIRES:  SEP  77 

Apr  77 


Figure  B2.  60- Degree  steep  turn  score  iheet. 


SLOW  FLIGHT 


STUDENT  _  INSTRUCTOR  _ 

MISSION _ DATE  ___ _  WINDS 


ALTITUOE 

OEV1ATION 


CRITERIA 


F 

ALTITUDE 

G 

E 

F 

AIRSPEED 

G 

E 

♦200- 

♦150' 

♦  100' 

72k 

74k 

75k 

84k 

82k 

80k 

HEADING 

F  G  E 

♦i4  no  *5 


In  arriving  at  an  overall  rating,  IP's  should  consider  In  addition  to  those 
Items  above,  timeliness  of  corrections,  smoothness,  power  control,  and  proper 
configuration. 
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Apr  77 


Figure  B3.  Slow -flight  wore  sheet. 


25 


STUDENT: 

MISSION: 


STRAIGHT-IN  APPROACH  l  LAjglNG 

_  INSTRUCTOR:  _ 

DATE:  _ 


HINDS: 


STRAIGHT. IN  AIRSPEED  (BEFORE  6/P) 


9SK 

100K 

10SK 

uok 

115K 

1 _ 1 _ 

1 — 1 — 1 _ J _ 1 _ 1 — 

■  I.  >  J 

J _ 1 _ 1 

_ 1—1 _ 1 _ !_ 

STRAIGHT- IN 

ALTITUDE 

DEVIATION 

CENTERLINE  DEVIATION 

lUlL-WT  1  JUST  Off — 1 

—an 

2200' _ 

CRITERIA  POR  STRAIGHT* I 

N 

_  2100' 

ALTITUDE 

CENTERLINE  DEV 

_  2000' 

STD: 

10K 

1900' 

ON  CENTER 

—  1900' 

LIMIT: 

F  -2 
♦10 

F  ♦200* 

F  Hat  OFF 

1800' 

6  *1 

6  4150* 

6  JUST  OFF 

_  1700* 

♦10 

1600* 

£  -0 

E  4100* 

E  ON 

♦5 

GLIDE  PATH  AIRSPEED 

95K  100K  10JK  11 OK  115K 

I _ t _ I _ 1  -  i  1 _ I _ l _ I _ i.-l _ L— 1 _ I _ I _ J _ I _ I _ I _ I _ 1 


OlIDEPATH  ALTITUDES  TOUCHDOWN  POINT 


In  arriving  it  to  overall  rating,  IP'i  should  consider  In  sddltlon  to  those 
ItSSM  stove,  tlawllness  of  corrections,  saoothnoss,  power  control  end  proper 
configuration. 


1 

overall  RATING 

2  3  4  $  6  7 

8 

□ 

rT^n 

i  i  i 

CZJ 

Form 
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ONE  TINE 

l 

EXPIRES:  SEP  77 
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Flfurt  B4,  Stniflit-ta  and  batting  score  sheet. 
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Table  Bl.  Combtton*  Between  IP  and 
APM  Evaluation 


VlltlblH 

r  < 

#t(«-a) 

t 

Maximum  Pitch 

Takeoff 

.763 

126 

13237*** 

Minimum  Pitch 

.168 

126 

1.908* 

Ground  (Left  Edge) 

.456 

126 

5.749*** 

Ground  (Right  Edge)  .551 

126 

7.404*** 

Liftoff  (Left  Edge) 

.620 

126 

886?*** 

Liftoff  (Right  Edge) 

.672 

126 

10.147*** 

Overall  Score 

.430 

126 

5.341*** 

Maximum  Altitude 

Steep  Turn 

.758 

125 

13.026*** 

Minimum  Altitude 

.905 

125 

23.901*** 

Maximum  Bank 

.826 

125 

16.477*** 

Minimum  Bank 

.878 

125 

20.548*** 

Maximum  Speed 

.905 

125 

23.887*** 

Minimum  Speed 

.946 

125 

32880*** 

Overall  Score 

.481 

125 

6.1 63*** 

Maximum  Altitude 

Slow  Flight 

.912 

126 

24899*** 

Minimum  Altitude 

.818 

126 

15.931*** 

Maximum  Speed 

.706 

126 

11.175*** 

Minimum  Speed 

.831 

126 

16.763*** 

Maximum  Heading 

.925 

126 

27.288*** 

Minimum  Heading 

.735 

126 

12.175*** 

Overall  Score 

.602 

126 

8.460*** 

StraighMn  and  Landing 

Maximum  Altitude* 

.960 

125 

38.207*** 

Minimum  Altitude1 

.358 

125 

4.305** 

Maximum  Speed1 

.308 

126 

3-629** 

Minimum  Speed1 

.329 

126 

3.907** 

Maximum  Speedb 

.825 

120 

16888*** 

Minimum  Speedb 

.869 

120 

19.715*** 

Touchdown  Point 

.860 

126 

18893*** 

Overall  Score 

.576 

126 

7.914*** 

‘prior  to  bite»ectk>n  of  flldeptth. 

bon  glldepath. 

*  p  <  .055. 

••  p<  .001. 

•••  p  <  .0001. 


APPENDIX  C:  DEFINITION  OF  PERFORMANCE  MEASURES 


The  measures  of  performance  used  in  the  data  analysis  for  each  task  are  presented.  Included  are 
scores  from  the  ASPT  Automated  Performance  Measurement  System  as  well  as  derived  scores  from  the 
Special  Data  Cards  described  in  Appendix  B. 

L  ASPT  A?MS  Scores: 

All  scores  represent  RMS  deviations  about  the  desired  value.  For  each  measure,  the  desired  value  and 
the  rules  for  beginning  and  ending  the  scoring  are  presented. 

A.  Takeoff 

1 .  Heading  Deviation.  Desired  heading  301°.  Measured  from  brake  release  until  1900  feet. 

2.  Fitch  Attitude.  Desired  value  is  6.1s,  a  criterion  derived  by  having  experienced  IPs  fly  the 
maneuver.  Measured  from  75  knots  until  flaps  are  retracted. 

3.  Climbout  Altitude.  Desired  value  is  a  function  of  airspeed.  Desired  altitude  s  1900  -  (196  - 
Airspeed)10.  Measured  from  1500  feet  (100  feet  AGL)and  terminates  at  1900  feet. 

B.  Steep  Turn 

1 .  Airspeed.  Desired  value  is  160  knots.  Measured  continuously. 

2.  Altitude.  Desired  value  is  15.000  feet.  Measured  continuously. 

3.  Bank.  Desired  value  is  60°.  Measurement  begins  6  seconds  after  bank  greater  than  40°  and 
terminates  upon  computer  command  to  “roll  out”. 

C.  Slow  Right 

1.  Altitude.  Desired  value  is  15,000  feet.  Measurement  begins  6  seconds  after  indicated  airspeed 
is  lest  than  85  knots  and  continues  for  30  seconds. 

2.  Airspeed.  Desired  value  is  77.5  knots.  Same  start/stop  logic  as  Altitude. 

3.  Heading.  Desired  value  is  180°.  Same  start/stop  logic  as  Altitude. 

D.  Straight-In  Landing 

1.  Final  Approach  Altitude.  Desired  value  1900  feet.  Measurement  begins  15  seconds  after 
Unfreeze.  Continues  until  glidepath  intersection  at  1.25  NM. 

2.  Centerline.  Desired  value  is  zero.  Same  start/stop  logic  as  Final  Approach  Altitude. 

3.  Glidepath.  Desired  value  is  zero.  Begins  at  1 .25  NM  and  terminates  at  1000  feet  from  end  of 

runway. 

4.  Centerline.  Desires  value  is  zero.  Same  start/stop  logic  as  Glidepath. 

5.  Airspeed.  Desired  value  is  100  knots.  Same  start/stop  logic  as  Glidepath. 

II.  Special  Data  Card  Scores 

Range  scores  were  computed  by  taking  the  absolute  difference  between  the  maximum  and  minimum 
values.  Rotation  speed  during  takeoff  was  the  actual  value  recorded  by  the  IP.  Centerline  deviation  scores  in 
the  Straight-in  Landing  are  dichotomous  values  (0  s  Off:  I  *  On).  Altitude  deviation  while  on  glidepath  was 
scored  as  the  average  absolute  deviation  from  desired  at  1 .75, 1 .5,  and  1 .25  NM. 
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